Papers by George Anthony Constantinides
Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Quantized training improves computational and memory efficiency but introduces quantization noise. |
| Approach: | They propose to use stochastic rounding to improve LLM training but introduce quantization noise. |
| Outcome: | The proposed method can compensate for reduced accuracy during backpropagation. |